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ABSTRACT 



This paper explores children's efforts to make sense of 
graphs by analyzing two students' use of a computer-based motion detector. 

The analysis focuses on the students 1 growing understanding of the motion 
detector which enables them to plan their movements in order to create graphs 
and interpret them in terms of kinesthetic actions. Students gradually began 
to talk about the tool in ways that did not distinguish between the symbol 
and the referent. They also changed how they used the motion detector. This 
paper contributes to a reconceptualization of the nature of symbolizing, the 
learning of graphing, and the links between children's and scientists' 
graphing. (Contains 52 references.) (MM) 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 



PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL HAS 
BEEN GRANTED BY 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 



Body Motion 
and Graphing 



by Ricardo Nemirovsky 
Cornelia Tierney 
and Tracey Wright 



u S DEPARTMENT OF EDUCATION 
Office of Educational Research and Improvement 
EDUCATIONAL RESOURCES INFORMATION 
7 CENTER (ERIC) 

□ Thisxiocument has been reproduced as 
V-re6eived from the person or organization 

originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



• Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 




TERC 



Body Motion 
and Graphing 



by Ricardo Nemirovsky 
Cornelia Tierney 
and Tracey Wright 



Working Paper 2-97 




T E R C 

2067 Massachusetts Avenue 
Cambridge, MA 02140 



The Working Paper series 
is produced by 

TERC Communications 
2067 Massachusetts Avenue 
Cambridge, MA 02140 
(617) 547-0430 
communications@terc.edu 
http://www.terc.edu 



The work reported in this paper is supported by the National Science Foundation grant MDR- 9455746 . 
All opinions and analysis expressed herein are those of the authors and do not necessarily reflect the views 
of the funding agency. 



©1998 TERC. All rights reserved. 



4 



To Eleanor and Dina, two girls who taught us so much. 



The authors wish to thank the important feedback on previous versions 
provided by Dan Chazan, Rogers Hall, Steve Monk, Tracy Noble, 
Analucia Schliemann, and Paul Wagoner. 

A brief and preliminary version of this paper is in Tierney, Nemirovsky, 
Wright, and Ackerman ( 1993 ). 



Contents 



Introduction 

Contextual Remarks 

The Study 

Part I: Tool Perspectives 

Eleanor 

Dina 

Discussion 

Part II: Fusion 

Introduction 

Eleanor: “I’m going to try to make a pattern.’ 

Dina: “What if we just doodled?” 

Discussion 

Part III: Graphical Spaces 

Introduction 

Eleanor 

Dina 

Discussion 

Conclusions 

References 



. I 
. 3 
. 6 
. 8 

II 

17 

24 

27 

27 

30 

33 

38 

42 

42 

46 

52 

60 

63 

65 





Preface 



TERC is a nonprofit education research and development organization 
founded in 1 965 and committed to improving science and mathematics 
learning and teaching. Our work includes research from both cognitive 
and sociocultural perspectives, creation of curriculum, technology 
innovation, and teacher development. Through our research we strive 
to deepen knowledge of how students and teachers construct their 
understanding of science and mathematics. 

Much of the thinking and questioning that informs TERC 
research is eventually integrated in the curricula and technologies we 
create and in the development work we engage in collaboratively with 
teachers. In 1992 we launched the TERC Working Paper series to 
expand our reach to the community of researchers and educators 
engaged in similar endeavors. 

The TERC Working Paper series consists of completed research, 
both published and unpublished, and work-in-progress in the learning 
and teaching of science and mathematics. 
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Introduction 

This paper reports a study of how two girls, Eleanor 
and Dina, who were at the time 10 and 9 years old 
respectively, used a motion detector in the context of 
individual interviews. The episodes include the first 
22 minutes after Eleanor started to use the motion 
detector for the first time and 35 minutes of Dinas 
initial use of the same tool, 1 

Our analysis unfolds three themes: tool perspec- 
tives, fusion, and graphical spaces. Through the theme 
of tool perspectives, in Part I, we attempt to capture 
Eleanors and Dinas efforts in emulating the tools 
capabilities to enact graphical responses to body 
motion. Eleanor and Dina develop different tool 
perspectives that enable them to plan how to move 
to create certain graphs, as well as to interpret graphs 
by the kinesthetic actions. The theme of fusion, in 
Part II, explores Eleanors and Dinas emergent ways 
of talking, acting, and gesturing that do not dis- 
tinguish between symbols and referents; by merging 
visual traits of the graph, qualities of their motions, 
and the intentions guiding their actions, terms like 
“I,” or “here,” indicate at once past and present 
events, (e.g., the computer screen graph and the 
previous movement of the hand, or an “elephant” 
that the graph was intended to depict with the “beak” 
that it turned out to be). The theme of graphical 
spaces, in Part III, reflects our account of episodes 
in which a change in how the motion detector was 
used seemed to prompt Eleanor and Dina to investi- 
gate anew how the tool works; it was as if the change 



1 The motion detector that we have used was provided by Lipman 
Co. (Israel). 
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of the setup (e.g., measuring the position of an 
| electric train instead the hand) had turned the motion 
detector into something entirely different. 

Our analysis of these learning episodes strives 
| to grapple with two interrelated questions: 

| (1) What emerging resources do students bring to 

their making sense of graphing? 

When we talk about “resources,” we do not have 
in mind isolated rules or memorized examples, but 
experiential domains, that is, bodies of life experience 
that the student brings to the situation full of intui- 
tions, expectations, and ways of talking. An example 
may clarify this sense of “resource.” Eleanor and Dina 
brought to the interview situation their drawing 
experience. The drawing experience offered them 
| a rich background of ideas, kinesthetic patterns of 
body motion, and ways of describing visual shapes, 

| which enabled them to be surprised, articulate 
hypotheses, and organize their use of tools. We talk 
about emerging resources to emphasize that they 
are not just “retrieved” — as if they were modular 
ready-to-use objects — but continuously changed 
and transformed by the local history of the students 
situation. For example, an important dimension of 
Eleanor s and Dinas learning about graphing was 
their exploration of the ways in which drawing 
feels similar and different from graphing. 

(2) What patterns of significance do students develop 
to grapple with the surrounding situation? 

Here is another way to pose this question: 

What aspects of the situation are significant to the 
student, and how do they shift? At a certain time, for 
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example, Eleanor was intrigued that the motion 
detector seemed to become unresponsive to her when- 
ever she went beyond a certain distance from the 
sensor. This aspect lost significance later, after she 
reckoned that the motion detector cannot “see” that 
far and that she must use the tool without trespassing 
those intangible boundaries. At times, aspects that 
Eleanor and Dina perceived as irrelevant, such as the 
graphs appearing on the screen from left to right, 
shifted to the focal point of their inquiries, such as 
when Dina wanted to draw a “simple shape,” as a 
square might be. 

We think of the interviews as open-ended mathe- 
matical conversations with students, in which the 
participants create fictional worlds and unexpected 
ways of using tools and symbols. We participate in 
these conversations to gain insights not only into 
how mathematical situations appear from students’ 
shoes but also into our own mathematical under- 
standings (Confrey, 1992). By striving to closely 
relate Eleanor s and Dinas shifting perspectives with 
our own questioning on the nature of graphing, we 
come to conclusions that might contribute to a recon- 
ceptualization of the nature of symbolizing, the 
learning of graphing, and the links between childrens 
and scientists graphing. 




Contextual Remarks 

Many studies on the nature and learning of graphing, 
within the literature on mathematics education, have 
been erected on the assumption of some fundamental 
dichotomies. For example, researchers have analyzed 
students’ approaches by looking at misconceptions, 
or alternative conceptions, which are to be contrasted to 
the conception of the expert grapher (Janvier, 1978: 
Clement, 1989). Others focused on the polarity be- 
tween pointwise and shape-based understanding of 
graphs, a polarity that has been presented as an 
instance of the more general dialectic between process/ 
object which, according to several authors, underlies 
all mathematics learning (Dubinsky & Harel, 1 992; 
Sfard, 1991). Other studies focused on the opposition 
between external and internal representations. Exter- 
nal representations, in the form of tables, graphs, or 
equations, are viewed as corresponding to internal 
representations — cognitive versions of the symbol 
systems displayed on paper or on a computer screen 
(Goldin, 1992). 

These foundational dichotomies connect with 
polarities that are often viewed as being at the essence 
of human nature itself. Opposing “misconceptions” 
to the socially accepted conception of the expert, for 
instance, is a way of dealing with the general 
dichotomy between the social and the individual; 
that is, the individual becomes “encultured” by 
replacing his idiosyncratic approaches with the 
socially sanctioned approach. Depending on how it 
is used, the antithesis between external and internal 
representations may reflect the polarities objective/ 
subjective, matter/ thought, or social/individual. 



By focusing on one or another dichotomy, 
students’ performance is analyzed in reference to 
a standard and expert approach that is well known 
to the researcher (e.g., misconceptions are compared 
to a canonical conception). Consequently, it is not 
surprising that the literature highlights students’ 
mistakes and deficiencies; in other words, it stresses 
what the student lacks (e.g., “this student conceives 
the graph as a process but not as an object”). In 
consonance with an emerging research perspective 
(Cobb & Bauersfeld, 1995; Smith, diSessa, & 
Roschelle, 1993; Confrey, 1991), we avoid seeing 
students by their mistakes to be overcome, we look 
instead at the students’ emerging resources and how 
they relate to the use of tools and at the conversations 
in which the students participate. 

What we find questionable is not the use of 
opposed qualities or the making of distinctions, but 
taking them as essential dualisms underlying thinking 
and learning. Our perspective is influenced by writings 
characterized by an effort to overcome classic 
dichotomies, such as subject/object, signifier/signified, 
mind/body, or internal/external, as the constitutive 
elements of “reality.” 2 From this perspective, the 
notion of experience encompasses at once all the 
aspects of the ongoing human existence. Those dis- 
tinctions are meaningful ways of talking about and 
reflecting on past events, but they are not at the 
foundation of the human experience. When, for 
example, one participates in a conversation one does 



2 In our opinion, landmark works from this literature are Heidegger 
(1927/1962), Merleau-Ponty (1946/1989), and Wittgenstein (1953). 
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not distinguish a gesture as belonging to the body 
or to the mind, or when one reads a text one does 
not split the signifier (the letters on the text) from 
the signified (the story told by the text); actually, we 
sense these kinds of splits as a disruption in the flow 
of experience (e.g., suddenly the text is a sequence 
of letters). This philosophical tradition argues that 
the meaning of symbols is to be found neither in the 
specific thoughts that they express, nor in the objects 
to which they refer, but in their use, that is, in the 
practices they are part of. 

Recendy a number of studies have reported a 
renewed exploration on the learning of graphing 
(Beguin et al., 1994; Boyd & Rubin, 1995; Carraher, 
Schliemann, & Nemirovsky, 1995; Chazan & Bethell, 
1994; diSessa, Hammer, Sherin, & Kolpakowski, 
1991; Kaput & Roschelle, 1995; Monk & Nemirov- 
sky, 1994; Moschkovich, in press; Nemirovsky, 1994; 
Nemirovsky, 1996; Pratt, 1995; Stroup, 1994; 
Tierney & Nemirovsky, 1995; Vitale, 1995; Yeru- 
shalmy, 1996). The overall view that emerges from 
these studies is, according to our interpretation, one 
in which (1) learning graphing entails the enrichment 
of a broad range of experiential domains, involving 
the refinement of visual, kinesthetic, and narrative 
resources; and (2) the adoption of mathematical 
conventions does not diminish the open-endedness 
involved in their use. In a similar sense that no two 
Italians, Americans, or Brazilians are identical and 
that for each individual being Italian, American, or 
Brazilian is a particular ongoing coping with unfore- 
seen events, no two persons graphing are identical 
or bring the same resources to a new situation. 

O 
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Instead of the uniform “internalization” of the graph- 
ical conventions described in textbooks, we witness 
the creative, conflicting, diverse, and always shifting 
ways in which students strove to make sense of 
graphs and express themselves with graphs. 

The notion that thinking is an “embodied” 
activity — that our incarnate experience with the 
human body as a whole, not just the brain, is 
involved in how we conceptualize situations — 
has become fashionable. Besides the influential 
writing of Merleau-Ponty (1946/1989), the work of 
Johnson (1987) and of LakoflF (1987) has stimulated 
this trend. The bodily basis for understanding is 
central to this paper, but, in contrast to Johnson and 
LakoflF, our intent is not to identify core cognitive 
structures but to gain insights into how situations 
involving body motion and symbols look to the 
person in the shoes of Eleanor and Dina. 

Researchers (Mason, 1987; Lave & Wenger, 1991; 
Meira, in press) invoke metaphors involving the act 
of seeing in the process of understanding symbolic 
expressions — such as “seeing through,” “trans- 
parency,” and “fields of visibility” — to talk about 
the ways in which people construct and interpret 
symbolic expressions. An aspect woven into the 
common experience of seeing that appears to be 
significant for the study of symbol use is the shift 
among visual focuses, and how some of them are 
mutually exclusive or inclusive, such as when one 
looks at a landscape through a window: seeing the 
landscape is, to a certain extent, not-seeing the 
window and vice versa, but, at the same time, the 
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sight of the landscape through the window fuses 
the landscape and the window within a unified 
experience encompassing how they relate to each 
other and to the viewer. 

An example of a similar phenomenon emerging 
in symbol use is a situation in which a person traces 
a line on paper and says “this straight line. . .” The 
understanding that this person expects to share 
requires some degree of not-seeing the trace — for 
no actual drawn trace is a straight line. On the other 
hand, the trace makes pointable a field of geometric 
relationships which is the actual subject of the 
speakers utterances and gestures. We are investigating 
how this kind of shared understanding grows, 
including episodes in which it does not occur, such 
as when the interviewer draws a curve intending to 
express the idea of an increase that rises continuously 
and the child strives to make sense of the interviewers 
drawing by focusing on its unintended pictorial 
qualities, such as some pieces that look more straight 
than others or one ending that seems vertical. 

The conception of symbol use as a complex 
seeing highlights another question: What does come 
into view? Latour (1986) made an important analysis 
of this question. He described how symbols are used 
by people and cultures to make present the absent. 
A conversation that uses a map, for instance, merges 
the here and now of the speakers with selected 
features of a distant land. The represented land is 
brought to the site of the conversation in ways that 
make it partially pointable and accessible. Latour 
talks about the constitution of a “common place” 
that is shared by symbol users. The common place 



is populated by absent experiences, objects, and 
events that come into view within the localized 
here and now of the symbol users. The idea of a 
common place is important to our research because 
we explore childrens making sense of symbolic 
expressions — Cartesian graphs representing their 
body motion — - as a creation of a common place, 
which we call “graphical space”: a space that is 
gradually enriched by past experiences and which 
becomes part of conversations and gestures. 
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The Study 



This paper reports a study of how children used a 
specific tool — a computer-based modon detector — 
to make sense of symbolic expressions in the form of 
Cartesian graphs of position vs. time. We exemplify 
our analysis with excerpts from individual interviews 
with two girls, Eleanor and Dina, who are 1 0 and 9 
years old respectively. The interviews were conducted 
as part of the Students Conceptions of the Mathe- 
matics of Change project. 

We analyze the activity of Eleanor and Dina in 
their initial work with a motion detector. The motion 
detector we use consists of one small object — the 
“button” — whose position is measured, a sensor 
or “tower,” and a computer. The children often hold 
the button or they may place it on a moving object, 
such as an electric train. For the interviews reported 
in this paper we set the interface so that the computer 
monitor displays in real time a graph of the changing 
distance between the button and the tower; that is, 
a graph of distance vs. time appears on the screen as 
one moves the button (see Figure 1). 



Beyond a distance of three meters the detector 
does not measure and the computer graph flattens 
where the measurement was last taken. We set the 
graphical scales from 0 to 1 8 seconds and from 0 
to 4 meters. The computer screen displays a grid 
of dotted lines (see Figure 2). 

The interviews consist primarily of conversations 
between the interviewer and the child as the child 
uses the motion detector. During conversation the 
goal of the interviewer is to understand the child’s 
thinking and learning. In planning these sessions, 
we do not know ahead of time what will be rich; they 
are deliberately open-ended. Although we plan a 
possible sequence of tasks for the interviews, each 
interview is a unique event. We ask the children to 
talk aloud about what they are thinking. The inter- 
viewer responds naturally with expressions of interest 
and also intervenes at times with restatements and 
questions, or to focus the child’s attention on aspects 
of the situation or upon the child’s own statements 
or actions. The interviewer cannot learn what the 
child thinks without affecting how she is thinking. 
We videotape the interviews and meet as a group to 




Figure I.A computer monitor displays in real time a graph of distance vs. 
time. 




Figure 2. The computer screen display of a grid of dotted lines. 
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discuss them together as well as to plan the next 
interview. The questions we pursue when we analyze 
the videotapes often arise from the data we observe. 
We do not limit our interest to what the child knows; 

o 

we also look at what is of interest to her, how she 
goes about finding out more, and how she relates 
to the interviewer. 

We have interviewed individually 12 children 
ranging in age from 7 to 14. We have chosen to write 
this paper about Eleanor and Dina because the 
sessions with them helped us learn and clarify ideas 
that became extremely useful for our analysis of the 
interviews with all the students. 

Dina and Eleanor first used the motion detector 
in the second of a series of hour-long individual 
interviews with the interviewer, Tracey Wright. In 
the first session they had drawn representations to 
instruct Tracey to move a handheld toy truck and 
an electric train in particular ways that each one 
established. Both children came to include 
instructions whether to go fast or slow, where to 
start or stop, and when to change direction. 

In their second sessions the children began 
working with the motion detector. The interviewer 
posed no particular tasks to Eleanor and Dina, 
instead she encouraged them to take charge of the 
investigation. Both children began by investigating 
what motions elicited a response from the motion 
detector. Each in her own way came to see that 
the line on the screen rises higher when one moves 
away from the tower and lower when one moves 
toward it. They then made use of their findings to 
explore something of interest to them. Later 

O 
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Tracey suggested a change of context in the use of 
the tool, such as using two buttons instead of one, 
so as to generate two graphs simultaneously or to 
attach the button to an electric train. 

The paper consists of three parts. With only 
one exception, the episodes are introduced in the 
paper following their chronological order, that is, 
whatever is presented later in the paper took place 
later in the interviews. Each part has an introduction, 
commentaries on the annotated transcript, and a 
discussion section. We indicate missing pieces of 
transcript with this symbol: (...). Almost all the 
missing pieces of transcript are short exchanges 
that refer to procedural details. 




Part I: Tool Perspectives 

As part of our everyday use of tools we often experi- 
ence a shift between the tool as an implicit aspect 
of our goal-oriented activities (e.g., using a knife 
to cut vegetables as one is making a salad) and the 
tool as an object of reflection (e.g., trying to figure 
out what type of knife is best to cut vegetables). 
These familiar experiential shifts have become an 
important theme for 20th-century philosophy As in 
the famous example of the blind mans cane, cited 
by Merleau-Ponty (1946/1989), Wittgenstein (1953), 
and others, the fluent use of a tool appears to involve 
its transparency in the service of accomplishing goals 
as well as its availability as a subject of analysis when, 
for example, the tool does not seem to perform as 
expected. If this is a suitable characterization of 
expertise in the use of a tool, what happens when the 
tool is unknown and unfamiliar to the user? How 
does expertise develop? Part I of this paper is a case 
study on these questions. In this instance the tool 
is a motion detector and the users are Eleanor and 
Dina as they encountered the motion detector for 
the first time. 

Vygotskys (1978) description of the development 
of expertise in tool use as a process of internalization, 
through which the individual becomes encultured, 
is well known. We avoid this language, however, to 
elude anchoring ideas on the external-internal dualism 
and because we want to leave open the question as 
to when and how fluency in the use of tools involves 
enculturation. Our analysis highlights the develop- 
ment of what we call a “tool perspective.” Adopting 
a tool perspective involves emulating the tools 
sensitivity to certain aspects and not to others, to 

O 
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enact conditions under which the tool is to be 
used, and to recognize patterns of significance in the 
tools products. 

A possible example of tool perspective is the 
interpretation of X-ray photographs. Many of us 
have participated in a conversation with a physician 
analyzing a X-ray photograph from a part of the 
body. Often the physician points to a small gray area 
on the image and asks “See this?” to help us focus 
on a little spot that otherwise might be absolutely 
unremarkable to us. The patterns of significance 
expressed by the physician can be very counter- 
intuitive to a lay person; what looks salient may 
be an irrelevant optical artifact of the X-ray device. 
Interpreting X-ray images — our example of adopting 
a tool perspective — involves not only knowing 
anatomy, pathology, and other biological sciences 
but also awareness of what is visible and invisible 
to the device and how idiosyncratic limitations of 
the tool produce visual traits to be ignored. 

Just as the X-ray device or any other measurement 
instrument has certain limitations, so too does the 
motion detector (e.g., it cannot measure beyond a 
certain distance). Besides these limitations, the motion 
detector has been designed assuming that the user 
would conform to certain performance requirements, 
such as always facing the button toward the tower. 
Finally, the designers of the motion detector adopted 
as “natural” certain expectations; for example, that 
temporal graphs are always drawn from left to right 
or that connected lines are supposed to be seen as 
continuous even though the pixel structure of the 
computer screen may show them as bumpy. 
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When children begin to use the motion detector 1 1 
they are aware of neither its general limitations nor |l 
the kinds of actions that the user has to avoid (e.g., jj 
obstructing the optical link between the tower and I 
the button). In addition, children do not necessarily 
come to the situation sharing cultural expectations 
as they are reflected in the tool (e.g., that time cannot | 
reverse direction). Through their initial use of the 
motion detector, Eleanor and Dina began gradually j| 
to discriminate between what for each one of them jj 
were idiosyncratic aspects of the tool use to be ignored 
or just complied with (e.g., hold the button facing jj 
the tower, stay within the measurement range of 
the tower), and what is significant to interpret and 
play with (e.g., the graph goes always to the right, 
getting closer moves the graph down). It is not the 
case that every possible aspect of the tool use is either 
idiosyncratic or significant in a general sense; instead, 
the idea is this: anything that becomes an issue for 
the tool user (e.g., the impossibility of graphing a 
square) tends to gravitate toward being more or less 
significant in ways that are not necessarily the ones 
intended by the designers of the tool. 

Note that we talk about developing a tool per- 
spective and not the tool perspective. We avoid 
deterministic views according to which the use of 
a tool would necessarily force the tool user to develop 
a given perspective; tool perspectives are open ended. 

For this reason we emphasize the distinction between 
what is idiosyncratic and significant to the tool user. 
Blocking the button with ones hand to create vertical 
lines might be significant for someone, even though || 
it is not intended to be so by the designer of the tool. 



Tool perspectives may be different for different 
individuals and also change for the same individual 
as she experiments and reflects on the use of the actual 
tool over time. Developing tool perspectives enabled 
Eleanor and Dina to anticipate how the graph should 
look, so that if the graph did not conform to their 
expectations they would try to recognize accidental 
mistakes in their motions or inherent limitations of 
the tool to explain the discrepancy. 

The episodes included in Part 1 describe the first 
10 minutes of each students use of the motion 
detector. The first half focuses on Eleanor and the 
second on Dina. Each half is divided in three sections. 
Our central aim is to describe specific aspects in 
Eleanors and Dinas process of developing a tool 
perspective for the motion detector, hoping that such 
an account might broaden our understanding of what 
is involved in becoming fluent tool users. Our 
analysis strives to articulate three contributions: 

1. The foremost quality of the tool was, for 
Eleanor and Dina, its responsiveness to their 
body motion . They began by striving to identify 
which elements of their body motion the motion 
detector was sensitive to. This is the focus of the 
first section ofPartI( <l Responsiveness of the TooT). 

2. Eleanor and Dina gradually envisioned a tools 
point of view from which certain actions were 
noticeable and others indiscernible. This is the 
subject of the second section of Part I (“The Tool 
as a Point of View”). They each strived to find 
out how what they perceived as significant and 
idiosyncratic traits in the behavior of the tool 
affected “its” perspective. 
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3 . Finally, the third section of Part I ('Emergence 
of Logical Necessity ”) illustrates how Eleanor and 
Dina considered what types of graphical produc- 
tions are possible , impossible, or difficult , 
expressing their growing sense of how the tool 
assumes a certain logic. 

Keep in mind that these three focuses of analysis 
do not attempt to separate distinct sequential phases. 
Eleanors and Dinas views on the responsiveness of 
the motion detector to their body motions, for 
example, does not end with the episode included in 
the first section. Rather, we have chosen to highlight 
a certain aspect in our analysis of each set of episodes 
— even though it develops throughout the whole 
interview — because of its conspicuousness at that 
particular time. 

Before starting the analysis of the episodes we need 
to clarify what we mean by “actions” and “responses” 
because we make repeated use of these terms. By 
actions we mean situated and intentional attempts 
to affect ones circumstances (Suchman, 1987). 
Actions are situated because they incorporate, on an 
ongoing basis, local and contingent aspects of the 
actors setting. Actions are intentional because they 
express desires to accomplish shifting and at times 
conflicting purposes that emerge from the history 
of the situation itself We think — as in the famous 
Ryles (1963) discussion on the difference between 
winking and closing ones eye as a result of a nervous 
tic — that understanding actions involves grasping 
the lived situations, intentions, and histories sur- 
rounding their occurrence. Suppose, for example, 
that a man is hammering a nail on a wall. Under- 



standing what he is doing is not just a matter of pro- 
ducing a detailed description of his arm movements; 
it may be crucial to know that he is planning to hang 
a painting on the wall, that he has not much time to 
do it, and so forth. In other words, what enables us 
to make sense of his actions is to discern his local 
intentions and circumstances. 

Schon (1987) and Bamberger and Schon (1991), 
through their description of the design process as a 
“conversation with the elements of the situation,” 
suggested that actions and responses constitute each 
other continuously. Responses often bring to the fore 
unexpected issues and questions. Let us briefly go 
back to our man hammering a nail on the wall. He 
hits the nail expecting that it will penetrate the wall 
a bit more, but, instead, the nail bends; this is to him 
an unintended response. He then needs to cope with 
the unintended, by, for example, starting all over 
with a new nail. Some responses prompt the actor 
to adopt a more reflective attitude. For example, the 
nail might, instead of getting deeper into the wall, 
stay at the same depth and produce a metallic noise. 
The man would then wonder what the nail could be 
hitting and whether another location on the wall 
would be more suitable. Responses emerge within the 
actors interpretive activity; moreover, actors are 
often trying to figure out whether a certain event 
counts as a response or not. It may matter to our man 
trying to hang the picture on the wall whether a 
sudden break on the wall was due to his hammering 
or whether it would have happened anyway. We 
chose to exemplify our notion of actions and responses 
with a person using a tool because it might be seen 
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as obvious that in a human interaction, such as in a 
conversation, actions and responses constitute each 
other on a continuous basis. 

Eleanor 



start, and you can move that [indicating the 
button in Eleanor s hand]. And ids going to 
respond to the tower. So [as she moves her 
hand a horizontal line begins to appear on 
the computer screen, (Figure 4, Segment 1)]. 



Introduction 

These episodes took place during the second 
session with Eleanor during the initial 10 minutes 
of Eleanors use of the motion detector. Previously 
Tracey and Eleanor exchanged ideas about ways of 
representing the motion of a handheld truck. The 
three sections include episodes according to the time 
scale shown in Figure 3. 

Responsiveness of the Tool 

Tracey introduced the motion detector, high- 
lighting the button, the tower, and their mutual 
relationship. 3 



<2> Eleanor: [producing Figure 4. (See Figure 5 to 
recognize the different types of movements that 
Eleanor tried.)] [She moves her hand laterally 




O 



<1 > Tracey: This is a button, and this is a tower. 
And this is how this works. If I push El it’ll 
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Figure 3. Time scale of Eleanors initial 10-minute use of the motion detector. 
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Figure 5. Eleanor tests the graphing capabilities by using different types of 
arm movements. 



3 This was Traceys first interview using the motion detector. 
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in a counterclockwise circle , the line lowers a 
little bit i Figure 4, Segment 2.J Let me move it 
farther away. [She walks backward away from 
the sensor. ] The line goes up [as she produces 
Segment 3, then she continues walking back- 
ward and the line flattens , Segment 4]. Maybe 
this is the farthest it can go. What if I move it 
up higher? [She walks forward and moves her 
hand up high , Segment 5. Then she walks 
backward and walks forward all the way to the 
sensor y Segment 6]. The closer to the tower it 
gets, the lower, I think. [She walks backward 
away from the sensor producing Segment 7]. 
And I think it gets. It gets higher until this line. 
[She walks in and points to the screen where the 
line has flattened in Segment 8J. And then it 
[the graph reaches the end of the scale and 
stops]. Wait, oh, I cant do it anymore. How do 
you clear it [the computer screen]? (...) 

Eleanor began her use of the motion detector to 
investigate the graphical responsiveness of the tool 
to her kinesthetic actions. Her first counterclockwise 
movement of her hand did not engender a significant 
response on the computer screen (Figure 4, Segment 
2). As soon as she tried a movement back with her 
hand, however, the tool seemed to wake up (first 
curvy piece in Segment 3). This graphical response 
encouraged Eleanor to further pursue the movement 
back by walking steadily away from the tower. 
Beyond a certain distance the line flattened even 
though she continued to walk back (Segment 4). 
The silence of the tool, as Eleanor stepped outside 
an unmarked region, made her aware of apparent 
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boundaries and inspired this comment: “Maybe this 
is the farthest it can go.” The-“it” of her comment 
was probably not the button she was holding in her 
hand — there were no limitations for the location 
of the button — but the engagement between the 
button and the tower. Striving to break the passive- 
ness of the tool, Eleanor held the button up and also 
walked a bit closer. The graphical jump down of 
Segment 3 and its subsequent flattening out did not 
provide Eleanor any clues about a possible significance 
of the vertical movement. Her walking forward 
instead, toward the end of Segment 6, prompted 
Eleanor to express a key insight: “The closer to the 
tower it gets, the lower, I think.” This utterance 
announced Eleanors sense that her distance to the 
tower gets expressed in the graphical height of the line. 

We want to highlight two interrelated aspects of 
Eleanors sense that closeness to the tower is expressed 
by the height of the graph: (1) Eleanor accounted for 
her experience of the most remarkable features of the 
tools responsiveness by articulating actions — getting 
closer, getting lower; and (2) Eleanor envisioned a 
qualitative relationship between the two measures, 
namely, that a decrease in one (getting closer) corres- 
ponds to a decrease in the other one (getting lower). 
More than specific correspondences (e.g., certain 
heights on the graph corresponding to certain dis- 
tances to the tower) Eleanor pointed out a relation- 
ship between changes along the two continuous 
magnitudes. We shall see later how Eleanor began 
to incorporate quantitative and pointwise elements. 
This action-based and qualitative graphical expres- 
sion of her closeness to the tower was important to 






Eleanor because it seemed to her a way of accounting 
for the responsiveness of the tool. 

As Eleanor produced Figure 6 she wondered 
about the tools response to stillness. 

<3> Eleanor: OK, so let's see. So. [Eleanor moves 
slowly away from the sensor. Segment 1 (see 
Figure 6). Then she stops part way back and 
holds the button still in front of her. ] What if 
I just leave it here? Will it keep on going? [The 
graph is a horizontal line, Segment 2] Yeah. 
What if I move it up [Eleanor moves her arm 
up. Segment 3], wait, let me see. So it goes. . . 
[She walks closer to the tower, Segment 4], the 
closer I go, the lower it goes . . . 

Grasping the responsiveness of the tool involves 
an awareness of what aspects are not responses, in 
other words, what the tool does on its own. Pursuing 
her systematic investigation, Eleanor found an 
example of graphical activity (going to the right) 
that occurs in the absence of kinesthetic actions: the 
graph “keeps on going” even if she “just leaves it here.” 




Figure 6. Eleanor’s graph reflects her curiosity about the tool’s response to 
stillness. 



Then Eleanor tried holding the button up high again, 
she had not ruled out the tools sensitivity to vertical 
motions. Our work with Eleanor and other children 
showed us that a sense of responsiveness, such as “the 
closer I go, the lower it goes,” does not preclude 
other possibilities; the tool might respond in that 
way and still be sensitive to other body actions 
that do not seem to affect closeness to the tower, 
such as vertical hand motion. 

During her initial interaction with the motion 
detector Eleanor tried to grapple with two issues: 
What aspects of ones body motions are “visible” 
to the tool? (Here is another way to formulate this 
question: How should one move to elicit responses 
from the tool?) and What does the tool do on its own, 
that is, independent of ones actions? Through her 
exploration she began to perceive some significant 
aspects in the tools responsiveness: it seemed par- 
ticularly sensitive to the action of getting closer to or 
farther from the tower, and the graph seemed to go to 
the right on its own, even when she remained still. 

Eleanors ensuing experimentation with the 
motion detector pursued these same questions in new 
ways, portraying her remarkable refinement of what 
is to be taken as significant or idiosyncratic. 

The Tool as a Point of View 

Let us resume the episode when Eleanor was in 
the middle of creating Figure 6. 

<4> Eleanor: But what if I go, like, far and, like, 
no [she walks away from the tower creating 
Segment 6, then Eleanor sees that Segment 7 is 
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flat even though she still moved farther away 
from the tower], Hmm, why isnt it going as 
high ? Maybe I went too far, (. . ,) 

As Eleanor walked away from the tower the graph 
displayed an increasing line (Segment 6); however, 
contrary to her expectations that it should continue 
to do so, at 1.5 meters the graph flattened out 
(Segment 7). This flattening happened because 
Eleanor turned the button away from the tower, 
so that the optical link between tower and button 
did not work anymore. In producing the graph, 
Eleanor encountered two kinds of flatness (Segments 
2 and 7). Segment 2 was the graphical response to 
her stillness (“What if I just leave it here? Will it keep 
on going?”), but Segment 7 was puzzling to her. She 
did not perceive Segment 7 as a response to her 
actions because she was not aware of doing anything 
distinctive when the graph went horizontal; the 
computer had done it on its own. Segment 7 could 
not mean stillness because she had moved the button 
further away during its creation. Eleanor resorted to 
the idea of the maximum (“I went too far”), but this 
explanation could not account for Segment 7, because 
Segment 2 had been even higher. The result was 
Eleanors feeling that there was something strange 
around Segment 7 and the maximum height. To 
Eleanor, this reopened the issue of the maximum 
height reachable by the graph. 

Eleanor started a new graph (not shown here). 
She turned the button to face the tower again and 
the graph became horizontal around 1.5 meters. She 
struggle to interpret it (“Oh, I know it goes from. . .1 
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think it goes from, like...”) but Tracey decided to 
make explicit the issue of the button orientation. 

<5> Tracey: I just noticed one problem , and I think 
it has to do with the way you re holding it [the 
button]. If you hold it [the button] like this 
[toward the tower], it [the tower] can see better 
than if you turn it [the button] that way [away 
from the tower], it [the tower] cant see what 
you re doing, [Eleanor continues to generate 
the graph, and Tracey notices that she had 
accidentally turned the button away from the 
tower again], Youre turning it away again. 

Traceys explanation made Eleanor aware that the 
orientation of the button is a factor to consider in 
how to use the motion detector. Holding the button 
toward the tower became an aspect of good perform- 
ance with the tool, an action to conform with, 
rather than to play with. This is a central trait of 
the idiosyncratic aspects of tool use. Tracey wanted 
to eliminate turning the button as a component in 
the graphical production or interpretation; she did 
so by talking about the button bearing in the context 




Figure 7. Eleanors graph reflects what happened when she walked far away 
as she created a new graph. 
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of the tower seeing the button, an image that Eleanor 
would use later. 

Eleanor continued to investigate what happens 
when she walked far away as she created a new graph. 

<6> Eleanor: (. . .) Let's see. What happens when 
you're really far away ? (. . .) [begins Figure 7. ] 

<7> Eleanor : [She walks back as far as she can in the 
room. The line flattens in Segment 2 before 
she gets all the way back.] I think I'm going to 
Leave it like this for a minute. [She then reaches 
further back, holding the button as far away 
from the tower as possible.] Hmmm, I wonder 
if I hold it up high ? [She reaches high up in the 
air while standing way back, then she lowers 
the button to shoulder height and, producing 
Segment 3, walks in then slightly back.] 

The flatness of Segment 2 was the key aspect that 
she experimented with in Figure 7. As Segment 2 
appeared on the screen Eleanor tried out different 
actions to break its uniform horizontality (staying still, 
reaching as far back as possible, and reaching high up). 
The computer failure to respond to her actions moved 
her to conclude initially that various movements did 
not matter. 

<7> Eleanor: No. I think that the. . . this is the. . . 
maybe this [points to the horizontal line. 
Segment 2] is the highest it can go. I don't 
know. But, um, so if you get closer to it [the 
tower], it [the graph] gets... it goes down low 
[points to the low part of Segment 1]. And if 
you get far away it goes, um, well, when you're 
walking farther away it goes up high [traces 
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the upward piece in Segment 1]. Then it. . . then 
it goes to about here [Segment 2]. And then, but 
I don't think it really makes any difference if 
you go Like that [bending knees and moving 
button by reaching down low and moving it 
up high]. 

<8> Tracey: It [up and down movement] doesn't 
make a difference 1 

<9> Eleanor: Well, maybe it does. I don't know. I'll 
try it. [Eleanor begins another graph, she holds 
the button down on the floor and notices that 
the table might block the tower from seeing the 
button]. Maybe it [the tower] can't see [the 
button]. Wait, can I hold this tower like [on the 
floor], or should I just leave it there [on the 
table]? Because it [the tower] might not be able 
to see it [the button] right? If I put it [the 
button] down here [under the table] (. . .) 

Her subsequent use of the motion detector was 
mostly within the space visible to the tower, pre- 
serving the button bearing so that it could be sensed 
by the tower. 

In this episode Eleanor incorporated idiosyncratic 
aspects of the tool to her performance. Eleanor 
learned to recognize and enact peculiar conditions 
(not too far from the tower, the button always visible 
to the tower, etc.) within which the meaning of graphs 
is to be discussed and envisioned. It is from this con- 
text that we talk about Eleanors envisioning the tool 
as a “point of view.” Eleanor learned to recognize 
aspects of her body motion that were visible to the 
motion detector and conditions to be preserved so 
that the tool remains sensitive to them. 
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time its going that way [straight up] (...) 



We have reviewed how Eleanor came to perceive 
the graphical height on the computer screen as 
expressing the movements toward and away from 
the tower. To Eleanor this was a significant aspect of 
her tool use. It allowed Eleanor to imagine sequences 
of actions to achieve a certain graph; she could run 
thought experiments to anticipate graphical produc- 
tions. When an actual graph did not seem to validate 
their expectations, it was important for Eleanor and 
Tracey to recognize whether it was an issue of per- 
formance and adjustment — the management of the 
idiosyncratic — or a misunderstanding of what the 
graph means as a reflection of actions, that is, of how 
they grasped the significant. In this section we will 
examine how Eleanor conceived graphs that are 
possible, impossible, and difficult. This episode took 
place after 8 minutes of her experimentation with 
the motion detector. Eleanor wondered aloud about 
the possibility of creating a vertical line. Throughout 
this episode “it” refers to the graph line. 

<10> Eleanor: I wonder if you could get it to go 
straight up? Not like diagonal ? Probably you 
couldn't because if it would go straight up it 
would have to just be the same time , because 
its moving along, no matter what you do. 

< 1 1 > Tracey: Moving along in time ? 



Eleanor immediately expressed the impossibility 
of the vertical line (“Probably you couldn’t”), based 
on the notion that the graph moves to the right “no 
matter what you do.” Her utterance (“no matter what 
you do”) indicates that the displacement to the right 
is something that the tool does on its own, regardless 
of her actions. Eleanor recognized this feature as a 
significant aspect of the tool: it is not a matter of 
limitation, performance, or inaccuracy, but a crucial 
element in imagining the creation of graphs. 

Eleanor inferred that the only way to stop the line 
in its inexorable shift to the right side is “to kind of 
stop the time.” The movement of the graph from left 
to right is as “unstoppable” as the progress of time. 
Eleanor began to develop a perspective from which 
she could emulate the tools view of motion, space, 
and time. The next exchange expresses Eleanors 
growing sense that the vertical line is not just an 
isolated case, but one extreme along a continuum 
of possibilities. 

<13> Tracey: Do you think you could make a steeper 
line than this? Maybe you cant make it go straight 
up, but maybe you can make it a little bit. 

<14> Eleanor: Maybe, maybe if you do it faster. 

<15> Tracey: OK, shall we try that? 



<12> Eleanor: Yeah, so youd have to kind of stop the 
time and go like that [gesturing a vertical line 
on the computer screen]. And go like this [moving 
as if to rush away from the tower, still holding 
the button]. Because, because its moving along 
this way [to the right on the screen] the same 



<16> Eleanor: [She starts a new graph by running a 
short distance toward the tower and back and 
then stands still moving her arm quickly forward 
and back.] (. . .) Thais almost straight up. 

<17 > Tracey: Yeah, it is almost straight. 
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<18> Eleanor: So you can make it kinda go like this 
[holds finger slightly slanted to the left] even 
though you cant make it go like straight up. 
You can get pretty close if you do it faster. 

And when you do it slower you can get like 
[gestures a line close to horizontal] slower. 

Eleanor expressed her sense of what “should” 
necessarily happen. Eleanor judged that one could 
be more or less close to the vertical line by going 
faster or slower. She incorporated into her tool per- 
spective a way of showing speed: by closeness to the 
vertical. By doing so she enriched her appreciation 
of the significant; it made more likely that if she were 
to see a graph that becomes more horizontal when 
she moved more quickly, she might assume that the 
tool did not work properly since a sense of how it 
should work has become compelling to her. 

Dina 

Introduction 

Dinas approach to using the motion detector was 
different from Eleanors. She started assuming that 
graphical height corresponded to the speed of her 
motion (“low is slow”). She consistendy interpreted 
the graphs as indicating the speed of her motions. 
Gradually, Dina began to incorporate elements of 
distance in her graphical interpretations, leading 
her to construct a new meaning for the graphical 
height. Dina was especially interested in the figurative 
and aesthetic analysis of the graphs. Such an interest 
was reflected in her many spontaneous comments on 
finished graphs and plans for the production of new 



ones. This section includes the episodes that took 
place in the second session, as she started to use the 
motion detector, according to the time scale shown 
in Figure 8. 

Responsiveness of the Tool 

Tracey introduced the motion detector. 

<19> Tracey: Here is a button, and you can move the 
button and make . The computer will make 
lines on the graph. Ids [the towers] looking for 
the button now. Its eye is bokingfor it. And as 
you move the button [a graph starts to appear 
on the computer screen, Tracey moves the button 
generating a small wavelike graph, Segment 1, 
Figure 9] something's happened. Here [handing 
button to Dina], why don't you try? 

<20> Dina: I’ve never heard of something like that. 
[She takes the button and compbtes the graph 
moving her hand slowly forward, backward, 
and forward again, Segment 2.] (. . .) 
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Figure 8. Time scale of Dinas initial 10-minute use of the motion detector. 
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<21 > Dina : That [Figure 9] would kind of be at a 
low speed. 

<22 > Tracey: How did you know that ? 

<23 > Dina: Because I think that low is slow. 

<24> Tracey: That’s like on ours [she referred to the 
system that they had previously invented to repre- 
sent motion on paper for the electric train , in 
which higher meant faster ], that’s what we did. 

Probably expressing her previous experience 
creating ways to represent motion, Dina accounted 
for the graphical response to her actions by assuming 
that graphical height expressed speed (“low is slow”); 
accordingly, Dina incorporated the numbers along 
the vertical axis as referring to speed. 

<25> Dina: (. . .) [pointing to the 50 mark on the 
vertical axis] And here it also shows , it says 50 
down below. 

<26> Tracey: So you think if you moved it really fast 
then. . . 

<27> Dina: It would be at about 350 [on the 
vertical scale]. 



<28> Tracey: OK, why don’t you try that [to reach the 
350 mark]. See what happens. 

<29> Dina: [Producing Figure 10, she moves her 
hand away from the tower. Segment 1]. Well, 
you have to get far [she walks slowly back. 
Segment 2]. 

Despite Dinas speed-based interpretation of the 
graph, in her subsequent attempt to actually reach a 
high mark on the graphical scale Dina encountered 
the need to walk further back. In producing Figure 
10, Segment 1, Dina moved her arm quickly but the 
graph did not seem to go high enough; this failure 
prompted her to “get far.” This is the first example 
of a kinesthetic differentiation that she would enact 
several times: on the one hand, her overall distance 
from the tower; on the other hand, the back and 
forth movement of her arms; both get expressed in a 
graphical up-and-down curve. As soon as she finished 
Figure 10, Dina started to comment on it, appraising 
the graphs appeal as a visual object. 

<30> Dina: That one [Figure 10] looks like an 

interesting one. It’s straight, but I don’t know 




Figure 9. Dina’s initial graph at “low speed” 




Figure 10. Dina’s graph reflects her attempts to reach a higher mark on the 
vertical scale by using a different speed. 
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why it just gets my attention, (. . .) when I 
think about it , I would think the other one 
[Figure 9] is more attracting because of all 
the bumps, but. When I look at it [Figure 10], 
I dont know, I think of this one [Figure 10] 
more attracting [than Figure 9 ]. 

It is likely that Dinas preference for Figure 1 0 over 
Figure 9 was based on her experience in producing 
them. When Dina created Figure 10 she had more 
control, sensing the power to generate significant 
graphical responses. Tracey shifted the conversation 
toward the kinesthetic meaning of Figure 10. Dina 
made specific remarks that expressed her notion that 
the graphical height showed the speed of her motion. 

<31> Tracey: Hmmm. You were thinking about 
speed, like if you moved it [the button] fast 
what might happen, 

<32 > Dina : Yeah, I was wondering how the speed 
would change, 

<33 > Tracey: So you were moving slowly some times 
and then fast some times, [Dina: Yeah.] Do 
you remember which part of the graph you 




Figure II. Dinas graph reflects her experimentation with swiftness of arm 
movements. 



were moving slowly and which part you were 
moving fast? 

<34 > Dina: Well , it was a very short time but here I 
was a little slow [point c, Figure 10] in here 
[Point e. Figure 10] and here [Point a. Figure 
10]. And the fast times were all the tips. 
[Tracey: The fast time were all the tips.] I dont 
think this one really [Point b], but it's faster 
than the other parts [around Point b], I think 
the fastest part is right at this tip right there 
[Point d]. So. 

Instead of reviewing her actual actions Dina inter- 
preted that the low and high points of the graph must 
have been where she went slow and fast respectively. 
Dinas analysis of maxima and minima included 
details: maximum speeds lasted for “a very short 
time,” Point b is just a local maximum, and Point d 
is a global maximum. Dina’s interpretation of the 
graph as an expression of her motions speed led her 
to reconstruct how fast she must have moved at 
different times during her past creation of the graph. 
Nevertheless, the following exchange included again 
an element of distance to the tower in Dinas sense 
of the graphical responsiveness to her body motion. 

<35> Tracey: Ah-ha. So, what could you do to make 
it even faster? 

<36> Dina: Get farther. (. . .) [Dina creates Figure 1 1.] 

To create Figure 1 1 Dina stood at a “far” distance 
(around 2 meters), and moved her arm back and 
forth. Sometimes, as in Segment a, her arm move- 
ment was swift and some other times, as in Segment 
c, it was gentle and gradual. These differences were 
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clearly intentional — Dina was experimenting with 
the swiftness of arm movements. Observing 
v ] Figure 1 1 , Dina noticed how the graph responded 
to the abruptness of her arm motion by the sharp- 
ness of the curve, which she interpreted as expressing 
different ways of slowing down, that is, different ways 
of getting low on the graph. 

<37> Dina: On this one [Figure 11, Segment a] I 
kind of tried to think on how fast it would 
take to get slower That's why I kind of let this 
one get slower slow [Segment c], and this one 
[Segment a] kind of fast. [Tracey: Yeah.] 

<38> Dina: They look like birds, kind of 

<39> Tracey: They do. And this wing [Segment c] gets 
slower sbwly, and this one [Segment a] gets 
slower fast. And how about here [Segment b ] ? 

<40> Dina: Well, there it kind of stays at the same 
speed. So once it gets here [beginning of Seg- 
ment b], it keeps the same speed until there 
[end of Segment b[. 

Dina began making sense of the graphical respon- 
siveness to her actions by interpreting the graphical 
height as an expression of speed. This view may have 
grown out of her previous experience in inventing 
representations on paper with Tracey, in which Dina 
used vertical height to indicate speed. She repeatedly 
reconstructed how she had moved the button to be 
consistent with this interpretive framework. Gradually, 
Dina began to include elements of distance to the 
tower as a significant aspect; her failure to produce 
a “high” graph with just last arm motion, for example, 
led her to introduce a distinctive kinesthetic action, 
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that is, getting farther from the tower, from which 
she remained bodily still except for her arm motion. 
Her interpretation of Figure 1 1 , consistent with speed 
being shown in vertical height, accounted for the 
quickness of her arm motion by noticing how fast 
or slow one “gets slow” (moves down on the graph); 
but note that, in doing so, she did not compare the 
birds wings merely as a difference of height — which 
is the same for both wings — but as a comparison 
between their slopes. 

The Tool as a Point of View 

Eleanor had a need to know what the boundaries 
of the tool were before she was ready to work within 
them. It seemed important for her to know from the 
beginning what space in the room she could work 
within or what motions she could do that would 
elicit a visual response from the graph. Dina, on the 
other hand, worked more often within the limits of 
the tool and did not move out of range or bump 
against other constraints. She was more tacit in her 
discovery of the motion detectors constraints. 




Figure 12. Dina’s graph shows her work within the limits of the tool, not a 
discovery of its range or other constraints. 
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As Dina was getting ready to produce Figure 12, 
she expressed a blending of being far and fast as well 
as a kinesthetic “mixing” of walking and moving 
her arm. 

<4l> Dina : (...) OK. Vm just going to get far. I 
really want to get it fast. [She walks back to 
start far from the tower and produces Figure 
12 .] 

<42> Dina: Thais a little different. Well , different. 
These two [Segments 1 and 2] are the same t 
but anyways, its different , all over. 

<43 > Tracey: Which part was different ? You mean 
the whole thing was ? 

<44> Dina: Wei \ thereby these two parts [Segments 
1 and 2] are the same except this one [Seg- 
ment 2] doesn't have a stick going down [at 
the end]. It just ends there. They cut it. 

The modon detector had been set up to register 
1 8 seconds of movement. After 1 8 seconds it stopped 
displaying more measurements. Dina never got to 
finish the second symmetric bird, and, in fact, stopped 
her movement when she saw that her motion was no 
longer being graphed. Note the mysterious “they” in 
“They cut it.” Dina was aware that it was not her 
movement that had caused the o motion detector to 
stop; it was “they” (whoever is behind the doings of 
the computer) who created the constraint. 

In analyzing the picture, however, it was as if she 
were seeing the whole shape of the bird. Dina com- 
pleted the graph by imagining the missing piece. 
The time interval of the computer screen was an 
idiosyncratic trait for Dina in the sense that she 
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saw it as a matter of performance. Had she started 
the bird earlier she could have fit them within the 
screen. That the computer “cut” her graph did not 
cause her to question her approach to interpreting 
graphs; she could easily imagine an elongated 
screen. Emphasizing the idiosyncrasy of the screen 
limit. Tracey repeated Dinas assertion (“Yeah, they 
cut it”), and immediately reframed their conversa- 
tion with other aspects of the graph that were more 
notable to Tracey, such as the sharpness of Point c. 

<45 > Tracey: Yeah y they cut it. I was noticing too 
that you've got a really sharp point down here 
[Point c]. 

<46> Dina: I didn't really want to stay down at the 
bottom. I don't know . ; because I get bored 
watching it go slow. 

<47 > Tracey: (. . .) Do you remember what you did 
with your hands here [Point c ]? 

<48 > Dina: I just moved it up really fast y but close. 
Here [point b], I also moved it fast y but not 
that close. 

<49> Tracey: Close to what? 

<50> Dina: My little tower. 

<51 > Tracey: Oh y I see. Yeah y you have a point here 
too [Point b]. But this one [Point a] looks 
more rounded. 

<52> Dina: I wasn't. There I wasn't trying to go 
really fast. I don't know why. 

Sharpness of the vertices was for Dina a visual 
attribute that expressed her quick motion which, 
in turn, reflected her “feeling bored.” The aesthetic 
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analysis pervaded Dinas analysis of the graphs, 
including aspects like feeling bored or interested when 
watching a graph. Dina introduced for the first time 
an explicit account of graphical height showing 
closeness to the tower. She began to articulate a new 
point of view from which closeness to the tower as 
well as fastness were, for the motion detector, notice- 
able aspects of her body motion. Emphasizing the 
idiosyncrasy of the temporal limits of the graph, 
Dina commented on the first 3 seconds of Figure 
12 that look horizontal. 

<53 > Dina: Here [initial horizontal piece of Figure 
12] I didn't mean to make it go straight. It's 
that I didn't know it [the computer] was on 
already. Because when I get, I think the closer 
lam [to the tower] y the longer it [the computer] 
takes [to start] or something. Because it [the 
computer] took longer [to start] last time [in 
producing Figure 11]. 

Dina, as well as Eleanor, developed a sense for 
the tools point of view, that is, for aspects of the 
body motion that can be sensed by the motion 
detector (e.g., distance to the tower, quickness of 
hand motion), and for particular conditions that one 
has to enact to preserve the sensitivity of the tool 
(e.g., move within the time frame demarcated by the 
horizontal completion of the graph on the computer 
screen). Critical to her insights were (1) her interpre- 
tations of the differences between the actual graph 
displayed on the computer screen and the graph 
that would correspond to her purposeful actions 
(e.g., the complete birds in Figure 12), and (2) Traceys 
utterances suggesting central and accessory aspects 
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of the situation through the conversation, such as 
when she confirmed to Dina “Yeah, they cut it” and 
then she made an observation (“I was noticing too 
that youve got a really sharp point down here”) 
that moved the conversation onto the kinesthetic 
analysis of the graph. 

The Emergence of Logical Necessity 

After Dinas comment about her uncertainty as 
to when the computer starts, Tracey decided to press 
the start key when Dina was ready to begin a new 
graph. Dina created the graph in Figure 13. 

<54> Dina: (...) Wei [ here [pointing somewhere 
near the last part of Figure 13] it kind of 
came out messy but I was trying to make an 
N. It didn't fit. I wonder if you could draw 
something trying that. 

<55> Tracey: That would be interesting. What 
would you like to try to draw ? 

<56> Dina: Something easy. OK, maybe a box. 

That's easy. Pretty easy. Can you get this to go 
back? Like once it's over here [in the right 




Figure 13. Dinas graph reflects her discovery that something may be easy to 
draw but impossible to graph. 
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hand part of the screen] to go back [motioning 
with her hand toward the left on the screen]? 

I don t think you can y but. . . 

<57 > Tracey: Yeah y not the way its set up right now. 

In this episode Dina discovered that something 
may be easy to draw and impossible to graph. Note 
how a characteristic that was present in the graphical 
productions from the very beginning, the movement 
to the right, only now became an issue for Dina. As 
soon as she intended to draw a square the directional- 
ity of the graph presented itself as something to cope 
with. Expressing the significance of this new aware- 
ness, Dina started to think about what letters are 
possible and impossible to write using the motion 
detector. 

<58 > Dina : Should I try another one? 

<59> Tracey: What other drawing could you make? 

<60> Dina: Hmmm. Could I try to write something? 
1 don't know what y but . . . “the”? [Tracey: OK. ] 
Or “at y ” as long as its easy. Except how to make 
an “a” 1 dont know how y because it doesn't finish 
the circle [small “a”]. It would only be a bump. 

<61 > Tracey: Yeah. Huh. So the “N” works [Dina: 
Yeah.] y but the “a” doesn't. 

<62 > Dina: A “T” I don't think would work either. 
It [capital T] would be like an upside down L. 

It wouldn't have the stick in the middle of the 
straight one at the top. So it cant be a “ T ” or 
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Dinas insight about the constraint of the graph 
going always to the right was part of her construction 
of the significant because it constituted a general 
principle underlying the relationship between the 
computer graphs and her actions. No matter what 
one does, the computer graph keeps moving in the 
same direction. On the one hand, Dina saw this 
behavior as an intrinsic attribute of the motion 
detector, part of what the computer does by itself; 
on the other hand, she took from it a strong sense 
of how she should read a graph (from left to right 
without changing direction) and imagine the sequence 
of actions that would produce it (left to right is first 
to last). By creating a new taxonomy of possible and 
impossible drawings, Dina used the directional 
principle to examine under a fresh light a broader 
domain of hand drawn shapes; in other words, her 
realization went beyond the mechanics of the tool 
enabling her to a adopt an alternative view — the 
view of the tool — toward familiar shapes. Note that 
in this exchange Dina analyzed possible, impossible, 
and difficult graphs without actually trying to produce 
them, but just envisioning their creation. It is in this 
sense that we talk about an evolving tool perspective 
which incorporates whatever is significant to the tool 
user against a background of idiosyncrasies to be 
complied with in the actual performance with the 
motion detector. Her tool perspective, incorporating 
the logic “principle” of always moving to the right 
enriches her imagining of what is likely, impossible, 
or necessary. 

Our analysis of Dinas views on the logical 
necessity making some letters possible and others 
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impossible, strives to identify how it was lived by 
her. Expert graphers may recognize, for the same 
taxonomy, elements of cultural value that are not 
necessarily shared by Dina. For example, the impos- 
sibility for a temporal graph to change direction may 
seem to a knowledgeable adult, such as Tracey, a 
natural consequence of the irreversibility of time. 
But later in this episode Tracey had the following 
exchange with Dina. 

<63 > Tracey : And can you make it [the line graph] 
come back [to the left]? 

<64> Dina: I dont think you can . 

<65 > Tracey: How come? 

<66> Dina: I have no idea. I would think just 
because the computer isnt made to do it. 

That Dina used the graphs rightward movement 
repeatedly to imagine possible, difficult, and impos- 
sible graphs in the form of letters while she attributed 
this trait to a designer s choice suggests that a com- 
petent use of the motion detector does not always 
imply sharing the cultural background of the choices 
made for its design. 

Discussion 

Responsiveness of the Tool 



here? Will it [the graph] keep on going? She posed 
her question as she stayed still, then she tried to 
account for the tools response to her stillness. 
Noticing that the graph kept “on going,” she 
remarked “Yeah”: the tool had affirmatively 
replied to her. 

Eleanors and Dinas initial “problematic” (Confrey, 
1991) was to find ways of body motion to provoke 
salient graphical responsiveness. For instance, during 
the creation of Figure 4, Eleanor walked backward 
as she commented that the “the line goes up”; at a 
certain point, however, the graph suddenly flattened. 
At that instant she had not performed any distinctive 
motion; that is, she just kept walking backward. She 
then perceived the graphs flattening as something 
that the tool did by itself: “Maybe this is the farthest 
it can move.” The local circumstances surrounding 
the moment in which the graph became horizontal 
(such as that she did not “do” something distinctive 
at the time, that it happened as she was walking 
farther and farther from the tower, or that the graph 
seemed to go “with her” up to that point) were 
crucial aspects of how Eleanor made sense of the 
event. Then, to break the tools silence she raised 
up her arm and said, “What if I move it up higher?” 
Intending to recover the lost responsiveness, Eleanor 
changed her body motion from walking backward 
to vertical arm displacement. 



We see Eleanors and Dina s initial encounter 
with the motion detector as an exploration of the 
responsiveness of the tool to their own actions. For 
example, during Eleanors production of Figure 6, 
she asked herself: What if I just leave it [the button] 



Grappling with the responsiveness of the tool 
involved, most of all, dealing with the concord and 
discord between their intended graphs and the 
resulting graphs. For instance, Dina reckoned that 
the flat first 2 seconds of Figure 12 were not inten- 
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ded: “I didn’t mean to make it go straight. It’s that 
I didn’t know it [the computer] was on already.” 
One way in which they dealt with disagreements 
between intentions and responses was by overlooking 
or denying them. Dina, for instance, reviewed her 
Figure 10 by composing body actions consistent with 
her “low is slow” (see <23>) interpretation even 
though, from our observer’s point of view, this is not 
what she had done (see <33>). At other times Eleanor 
and Dina accounted for a divergence between inten- 
tions and responses by noticing what qualities of 
their body motion really count. For example, as 
part of her creation of Figures 4, 6, and 7, Eleanor 
attempted to get the graph line up higher by moving 
the button up and down, but in all cases her vertical 
movement failed to elicit specific responses on the 
computer screen. Later she accounted for the tool’s 
lack of responsiveness to the button’s vertical displace- 
ment by asserting that this is not a kind of body 
movement that one is supposed to play with (see 
the end of <7>). Pursuing a different avenue, Dina 
began to use the motion detector to highlight speed 
as the body motion quality that counts. However, 
after failing to reach the upper part of the computer 
screen, Dina began to include her distance to the 
tower in the foreground of her activity: “Well [as 
she produces Figure 10], you have to get far.” 

The Tool as a Point of View 

The metaphor of the tool as a point of view 
invokes the familiar experience of trying to imagine 
an object from a different viewer’s position (not the 
one from which we are already seeing the object). 



Envisioning an object from an alternative point of 
view involves recognizing what aspects of the object 
will be significant, salient, or notorious from the 
new angle, as well as to assume a background of 
idiosyncratic conditions to preserve the object visually 
available (e.g., the object must be appropriately 
illuminated, it should not be covered). Similarly, 
Eleanor and Dina began to recognize what qualities 
of one’s body motions must be highlighted and 
played with in the creation of graphical expressions 
because they are visible to the tool (e.g., moving 
one’s arm toward and away from the tower), and 
what aspects have to be part of a performance style 
(e.g., holding the button in a certain way, keeping 
oneself at a reasonable distance from the tower). 

The process of sorting out what is idiosyncratic 
(what one needs to comply with for the use of the 
tool), and significant (what kind of actions one can 
enact to control graphical responses) embraced not 
only Eleanor’s and Dina’s experimentation with the 
tool but also their interaction with Tracey For 
example, turning the button away from the tower 
might be used as a practical method to create hori- 
zontal segments in a graph, hence it could be a 
significant aspect in the creation of graphs. The 
interaction with Tracey, however, induced Eleanor 
to perceive the button’s orientation as a peculiar 
feature to comply with. Tracey advised Eleanor to 
account for the flattening of the graph at the end 
of Figure 6 by an aspect that Eleanor had been 
unaware of: “I just noticed one problem, and I 
think it has to do with the way you’re holding it 
[the button].” Tracey’s contribution was not only 



■ RJC JEJO^iOg Papers 



32 



25 



to bring up the buttons orientation to Eleanors 
attention, but also to treat it as a matter of good per- 
formance: “If you hold it [the button] like this 
[toward the tower] , it [the tower] can see better than 
if you turn it [the button] that way [away from the 
tower], it [the tower] cant see what you’re doing.” 
By talking about the tower having to “see” the button, 
Eleanor understood that she should always keep a 
relative orientation of the button, a feature that she 
would comply with after a bit of practice (“You’re 
turning it away again,” Tracey said after Eleanor had 
accidentally turned the button away from the tower). 
Developing and adopting the tool’s point of view 
seem to entail an anthropomorphization of the tool, 
such as the talk about the tower seeing the button 
or the sense that the tool is partially responsive to 
one’s actions, as other human beings are. 

The Emergence of Logical Necessity 

As Eleanor and Dina each enriched their concep- 
tion of the tool’s point of view, they articulated a 
sense of logical necessity which allowed them to 
discern between possible and impossible graphs. 
For Eleanor, the inexorable graphical displacement 
to the right made vertical lines impossible unless 
you “kind of stop time.” For Dina, it implied that 
some letters are possible and others impossible to 
graph. Letters are familiar objects to Dina; however, 
in her interest to draw them, she needed to look at 
them from a new perspective; she developed a 
taxonomy in which “T” and “a” are impossible, 
whereas “L” or “n” are possible (see < 62 >). By 
grappling with how to use the tool to draw a box 
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or letters, Dina encountered logical constraints 
that made apparent, to her, differences between 
drawing and graphing. It is this perception of how 
the tool “should” work that first suggested to us the 
notion of “adopting a tool perspective.” Eleanor and 
Dina strived to emulate not only the tool’s responsive- 
ness to body motion but also an inherent logic that 
they began to envision — a logic that enabled them 
to imagine what is possible and impossible to graph. 
Their emerging sense of logical necessity expressed 
simultaneously notions about the behavior of the 
graph (e.g., that it always goes to the right) and about 
the nature of body motion (e.g., that one cannot get 
farther away from the tower in no time). 

The three ideas that we have discussed — respon- 
siveness of the tool, the tool as a point of view, and 
the emergence of logical necessity — were all impor- 
tant aspects of Eleanor’s and Dina’s development of 
a tool perspective. Our intent is not to talk about tool 
perspectives as mental objects, but as interpretive 
frameworks that one can use to reflect on graphs and 
actions. The experience with the motion detector 
can help someone to imagine how a graph of distance 
vs. time corresponding to a car on a highway would 
look, regardless that, say, the car moves much beyond 
the range of distances that the tower is sensitive to. 
Tool perspectives emerge from one’s experiences with 
the tool — experiences that include conversations 
with others, successes and failures in achieving intended 
results, and styles of performance. 
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Part II: Fusion 

Graphic displays thus not only provide physicists with a 
cognitive domain to inhabit and wander in y they also 
transport physical phenomena into the perceptual presence 
of physicists and serve as a locus in which physicist and 
physical phenomenon can be brought into symbolic contact 
with one another. Cognitive and gestural orientation to 
a graphical representation , therefore, make possible for 
physicists to symbolically participate in the physical events 
represented by the graphic space. 



guish between symbols and referents. Let us review 
some examples from Part I. 

From <45>: 

Tracey: I was noticing too that youve got 
a really sharp point down here [Point c. 

Figure 12)]. 

Dina : I didnt really want to stay down at 
the bottom. 



— Ochs, Gonzales, & Jacoby (in press) 



Introduction 



A common way of talking about the understand- 
ing of symbols suggests that knowing the meaning 
of a symbolic expression is being able to recognize 
its correspondence to whatever it may refer to; for 
example, knowing the meaning of the word “table” 
implies the ability to point to the objects that table 
refers to. This image of correspondences between 
symbols and referents insinuates that understanding 
a graph of position vs. time would be grounded in 
the ability to establish links between points on the 
graph and positions of the moving object at a given 
time or between the slope of the graph at a certain 
time and the velocity of the object. Although 
Eleanor and Dina learned to establish some of these 
correspondences (e.g., “the closer to the tower it gets, 
the lower, I think” said Eleanor as she created her 
first graph), we see this emergent ability as part of a 
broader process that we call “fusion.” Fusion is 
merging qualities of symbols with qualities of the 
signified events or situations, that is, talking, ges- 
turing, and envisioning in ways that do not distin- 



1 RJ C ... TERC Working Papers 



Who is “I” in Dinas answer? Dina knew that she, 
in the sense of her body in the room, had never been 
“down at the bottom,” and yet her utterance makes 
sense to Tracey and to herself. The “I” that Dina 
invoked simultaneously moved the button back and 
forth and the graph up and down the computer 
screen and did not want to stay down at the bottom. 

From <47>: 

Tracey: Do you remember what you did with 
your hands here [ after Point c, Figure 12]? 

Dina: [referring to the upward piece] I just 
moved it up really fast, but close. 

Tracey asked Dina about her hand motion. Dinas 
response describes a movement up and fast. What 
was the “it” that moved up and fast? Her description 
fuses a quality of the graph (upness) with qualities 
of her hand motion (fastness and closeness). Dinas 
statement is ambiguous, but her ambiguity is not a 
matter of vagueness or uncertainty; rather, it is an 
expression of connectedness and understanding. 
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From <37>: 

Dina: On this one [Figure 11, Segment a] 

I kind of tried to think on how fast it would 
take to get slower. That's why I kind of let this 
one get slower slow [Segment c], and this one 
[Segment a] kind of fast. They look like birds, 
kind of 

Tracey: They do. And this wing [traces Segment 
c] gets slower slowly, and this one [traces Segment 
a] gets slower fast. And how about here [traces 
Segment b]? 

The conversation between Dina and Tracey reflects 
a shared growth and enrichment of the fusion experi- 
ence. Dinas remark about her intentions on the graph 
resembling a bird prompted Tracey to describe the 
wings as getting slower at different rates. Invoking 
Dinas interpretation (at that time Dina thought of 
the graphical height as showing speed), Tracey ges- 
tured the downness of the Segments c’ and ‘a as dis- 
playing their “getting slower.” Note the complexity of 
Traceys pointing act; in a single utterance she inte- 
grated the bird, the directionality of the graph, and 
a kinesthetic pattern. Look at her sentence: “This 
wing gets slower fast”; and try this exercise: replace 
“wing” by “graph” or “motion,” and “slower” by 
“down” or “inclined,” and “fast” by “steeply.” Every 
combination of these substitutions still makes sense 
to the situation. The issue is that Tracey was pointing 
at all of them and that Dina not only made sense of 
Traceys utterance, but she also generated, as in former 
examples, her own utterances involving similar 
degrees of complexity and multiple dimensions. 



Fusion involves the construction of a discourse in 
which indexical terms, such as “I,” “it,” or “here,” 
are constantly revised dissolving boundaries among 
all the aspects that are relevant to the graphers’ 
experience. The episodes with Eleanor and Dina 
exemplify that this discourse incorporates not only 
body movements and graphical shapes but also inten- 
tions (“I didn’t really want to stay down at the 
bottom”), evoked objects (“They look like birds, 
kind oF’), and past events (“Do you remember what 
you did with your hands here?”). 

The idea of fusion is, we believe, more appro- 
priate to the former examples than the metaphor 
of transparency. Learning graphing was not, for 
Eleanor and Dina, a matter of the graphs becoming 
“transparent,” because the visual attributes of the 
graphs remained present and salient to them (e.g., 
“they look like birds,” “I didn’t really want to stay 
down at the bottom”). Transparency implies that the 
graphs disappear from sight enabling the grapher to 
grasp what is “behind” them. Fusion, instead, suggests 
that the qualities of the graph merge with the qualities 
of the represented events in ways that they cease to 
be distinct. 

In previous presentations in which we included 
the notion of fusion, we have noticed two reactions 
that we want to dispute here. The first one is that 
fusion expresses students’ inability to separate symbols 
and referents; to put it more bluntly, that students’ 
fusion indicates their conceptual confusion. We 
believe that this view is simply false. It is not true 
that Eleanor or Dina could not distinguish between 
the shape of the graph on the computer screen and 
their actual body motions across the room. When- 
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ever the ambiguity of their words was an obstacle 
they could spell it out. Fusion, in our view, does not 
constitute a misunderstanding but an achievement. 

By coming to see body motions, past actions, and 
evoked objects in their graphs, Eleanor and Dina 
crafted a rich background of intuitions and insights 
nurturing their interpretations. This conclusion does 
not imply, obviously, that whatever form of fusion jj 
they attained was error-free and correct. For example, ! 
initially Dina mistakenly saw graphical height as an 
expression of speed. This surmise did offer her an 
interpretive framework; it was in the context of 
recognizing variations of speed in graphical shapes 
that Dina began to sense the need to account for the 
distance to the tower in her graphical productions 
(“Well, you have to get far,” Dina said in the middle 
of creating Figure 10; see <29>). 

The second reaction we have seen is that what we 
see as fusion is “just a shortcut” with little relevance. 
For instance, instead of “I didn’t really want to stay 
down at the bottom,” Dina could have said “I didn’t 
really want to stay close to the tower because the graph 
would have stayed down at the bottom of the 
computer screen.” From this point of view the former jj 
utterance was preferred because it is shorter and, 
presumably, easier to produce. However, this “short- 
cut” theory overlooks what we think is the most 
crucial quality of the fusing experiences: playfulness. 
Playfulness is at the root of symbol use (Piaget, 1962; 
Winnicott, 1982). Imagine that one sees a child who 
is playing and using a stick as a horse; the child then 
lets the stick fall on the floor while saying “my horse 
is tired.” Would one say that the child’s utterance is 
merely a shortcut because he could have stated “I 
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let this stick fall down because it stands for a horse 
which is tired”? The child is aware that the stick is 
not a real horse and yet acting, talking, and ges- 
turing, as if the stick were truly a horse, is at the 
essence of his play, of his ability to “get lost” in the 
make-believe situation. Moreover, unless the inherent 
ambiguity in the play encumbers communication 
or one wants the child to do something else, it is 
important to avoid disrupting the illusion; a question 
such as “How come you believe that this stick is a 
horse?” is likely to interrupt his play. 

Fusion is not an exceptional or anomalous phe- 
nomenon. On the contrary, it is ordinary and 
pervasive. It may take place when someone explains to 
a friend how to get somewhere on a map, in reading 
a poem where the sound of the words is a crucial 
aspect to what they come to mean, in a religious 
ritual, or in a conversation about the characters of a 
cartoon. But the experiences of fusion can be radically 
diverse. The type of fusion that emerges in the inter- 
pretation of a graph is not necessarily similar to the 
ones experienced in discussing directions on a map, 
reading a poem, or imitating a cartoon character. 

The goal of Part II is not just to show that fusion 
took place in the episodes with Eleanor and Dina, 
but, more important, to gain insights on the specific 
forms of fusion that they experienced which suggest 
important features inherent in the learning and use 
of graphing. Through the analysis of the ensuing 
episodes we will characterize three traits which are 
specific to the form of fusion developed by Eleanor 
and Dina and, we conjecture, to graphing: 



1 . The interplay between the graph as a shape 
and the graph as a response to actions . 

2. The interplay between graphing and drawing 

3. Imaginary traveling along trajectories on the 
graphical plane. 

The study of physicists’ use of graphs by Ochs 
et al., (1994, 1996), and which we consider to be 
seminal, suggests that these characteristics of the 
form of fusion enacted by Eleanor s and Dinas 
graphing are ingrained in the practices of all novice 
or experienced graphers: 

“Through verbal and gestural (re) enactments of 
constructed physical processes, physicist and physical 
entity are conjoined in simultaneous, multiple con- 
structed worlds: the here and now of the interaction, 
the visual representation, and the represented physical 
processes. These indeterminate grammatical construc- 
tions along with gestural journeys through visual 
displays constitute physicist and physical entity as 
coexperiencers of dynamic processes” (1994). 

Eleanor: “I’m going to try to make 
a pattern.” 

This section describes four minutes of Eleanors 
experimentation with the motion detector, following 
the time scale shown in Figure 14. 

As soon as Eleanor feels that she has a sense of 
how the motion detector responds to her actions, 
she expresses her desire to use the tool for a purpose. 
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<67 > Eleanor: OK, Tm going to try and make a 
pattern. [She alternately walks forward with 
her hand toward the sensor and then walks 
back away from the sensor. She doesnt back 
up as far each time. As she moves back and 
forth, Eleanor watches Figure 15 forming. ] 
Actually [right after producing seven peaks] 
this is not exactly the same pattern. [As she 
produces each of the last three peaks, Eleanor 
goes a shorter and shorter distance away from 
the sensor. ] 
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Figure 14. Time scale of Eleanors efforts to make a pattern with the motion 
detector. 




Figure IS. Eleanor’s graph reflects her attempt to make a pattern. 
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During the production of Figure 15 Eleanor 
intended to create a regular wavelike pattern. As the 
graph came into view she noticed that it showed a 
shape different from the one she intended (“Actually, 
this is not exactly the same pattern”). This type of 
comparison between the actual graph and the pattern 
that she intended to create is a prevalent element 
that Eleanor, as well as all the other children we have 
worked with, brought to their graphing experience. 
These are moments in which the graph is seen as a 
shape which is assessed on its closeness to a “target” 
shape (e.g., the regular wave in her previous graph). 

We call this mode of graph interpretation “graph 
as a shape”; we now trace how the graph as a shape 
interrelates with another focus of graphical inter- 
pretation: the graph as a response to actions. 

<68 > Tracey: Wow. Oh, I like that one. Wait , don't 
clear it yet. Let's stop it and look at it for a 
minute. [Eleanor traces it with her finger as if 
redrawing the graph.] What was happening. ? 

<69> Eleanor: Wei] I was going far. I was going, 
like, far, and a little bit closer but still far 
away then. I was really going like this [Eleanor \ j 
moves her arm in a back and forth motion] 
but kind of changing a little [not as far away 
each time]. 

Traceys question (“What was happening?”) 
shifted the conversation to the graph as a response 
to actions; that is, it prompted Eleanor to reflect on 
the body movements with which she had created 
Figure 1 5 and how they related to the graphical 
response on the computer screen. 
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<70 > Tracey : So the line up was when you were 
walking [how]. . . ? [Tracey points to one of 
the upward slanting Lines.] 

<71> Eleanor: When I was walking backward 

[gestures back wall], and the Line forward [she 
gestures a line with downward slope] was that 
way [looking toward the tower]. 

This exchange elicited a kind of talk and gesturing 
that makes explicit the phenomenon of fusion. 
Eleanor said “and the line forward was that way 
[she gestures a line with downward slope].” “The 
line forward” is the downward line on the computer 
screen as well as her walking forward. Tracey and 
Eleanor talk and gesture an entity that is at once 
on the computer screen and in her walking across 
the room; an entity that is simultaneously present 
and past: the line is presendy there as Eleanor points 
at it, but it also “ was that way.” Eleanor could have 
said, adopting Traceys language, “the line down was 
when I was walking forward,” which is, seemingly, 
a “clearer” expression. But we think that Eleanors 
spontaneous use of “the line forward” expresses a 
common and significant aspect in graphing. The 
graph, the symbolized events, and the multiple 
graphers’ interpretations are all experienced within 
a “graphical space,” in which they coalesce. Words, 
gestures, and images evoke at once qualities of 
shapes, body motion, tool responses, the past, and 
the future. The emerging space that Eleanor and 
Tracey experience, the one that they talk and gesture 
about, is common (borrowing from Latour s common 
place) in several senses: it is shared by both of them, 
it is populated by events of which they are mutually 
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aware (like Eleanors previous walk toward the tower), 
and it blurs boundaries between the graph as a 
shape and the graph as a response to actions. 

<72 > Tracey: The whole thing has sort of a shape 
too, doesn’t it? 

<73> Eleanor: Yeah, it's all, like zigzags through the 
side [she turns her head sideways and does a 
zigzag motion with her finger], but I mean 
they re all . They look Like, kind of like 
mountains or something 

<74 > Tracey: They do. 

By alluding to the overall shape of “the whole 
thing,” Tracey made salient Figure 15 as a shape. 
Note how Eleanor incorporated a figural resem- 
blance in her analysis of the shapelike qualities of 
the graph: “They look like, kind of like mountains 
or something.” In the section on Dina we will see 
more examples of the use of figural resemblance as 
part of the graph as a shape perspective. 

<75 > Eleanor: At first I was going to have it stay on 
this line [tracing her finger on a horizontal 
line from the top of the highest zigzags], but 
they got. They kept on getting smaller, so. 

<76> Tracey: Why did they get smaller? 

<77 > Eleanor: Because I. I didn’t walk as far. 

Traceys question turned again the conversation 
toward the graph as a response to actions. Traceys 
“why” prompted Eleanor to analyze causes, that is, 
what in her actions had caused the shrinking of 
the wave. 

O 
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Eleanor figured out a way to avoid the lowering 
of the peaks by using pads of note paper to mark 
places on the floor. 

<78 > Eleanor: Maybe I can mark where I walked 
to. And then like. Maybe I can Like just put 
this Like right here. [She places a Little note 
pad on the floor around 2 meters from the 
tower.] OK. Can I make a new one [a new 
graph on the computer]? (. . .) Maybe if I, Like, 
start here. [She goes near the sensor. ] No, if I 
start here [she walks back and stands on the 
pad] it will be like up [the beginning of the 
graph]. [Eleanor creates Figure 16 by walking 
six times at a steady pace up to the sensor and 
back, stepping on the pad each time. The 
seventh time she steps back beyond the pad. ] 
(-) 

Eleanor decided to mark on the floor the point 
at which she would change direction. This action 
suggests how Eleanor conceived another way in which 
height on the graphical space shows location in 
the room. She did not look at the number scale 




Figure 16. Eleanor’s graph confirms her idea to make a more uniform 
pattern by marking on the floor the distance she needed to move. 
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for a certain distance; instead, she came to expect from 
her previous experience with the tool what location 
of the mark on the floor accords with a middle height 
on the screen. Eleanors approach to how specific 
places on the floor correspond to specific heights on 
the computer screen was not a unit-based measure- 
ment, but an experiential sense of “being here” in 
which “here” meant simultaneously a place on the 
floor and on the computer screen. 

<79> Eleanor: [looking at Figure 16] That one [the 
last peak] went up a little too high y but . . . 
[Touching each of the peaks on the graph]. That 
one [this graph] was kind of more the same [each 
peak is almost the same as each other] but a little 
bit different [from each other]. Because I didn't 
always , also I didn't always go in, in the same 
place [pointing to bottoms of each peak which 
are slightly different], but it goes, tsh, tsh, tsh, 
tsh [touching the tops of the peaks], 

Eleanors comments on Figure 16 combined 
aspects of the graph as a shape (e.g., “That one [this 
graph] was kind of more the same”) and of the graph 
as a response to actions (e.g., “also I didn’t always 
go in, in the same place”). 

Throughout Eleanors explorations both perspec- 
tives were intertwined and under mutual influence; 
in this episode Eleanor first wanted to make a regular 
wave, she then envisioned a way of walking that 
would engender such a shape and created Figure 15; 
noticing that the pattern was not regular she thought 
of ways of adjusting her body actions to achieve the 
missing regularity in the shape, an issue that she 
assessed after producing Figure 16. 



Dina: “What if we just doodled?” 

This section describes the activities with the 
motion detector that directly follow the episodes 
included in Part I. Immediately after pondering 
which letters are possible and impossible to create 
on the computer screen (described at the end of 
Part I), Dina tried twice to draw an “N” on the 
computer screen. 

<80> Tracey: Well, I could just turn it on and you 
could experiment with the drawing idea, 

<81 > Dina: [as she creates a graph not shown here] 
OK. Oopsies. Well, there starts an N, I think. 
It's kind of big, but. . .just gonna make waves, 
because I kind of messed up on it. Hmm, I 
don't know. 

<82> Tracey: So that was a drawing of waves. 

<83> Dina: I don't really like it. 

<84> Tracey: But you don't like it because you were 
trying to do something different. 

<85 > Dina: I wanted to make an N, but it came 
out kind of flat there. It had to be taller. 

<86> Tracey: So do you want to try a taller N this 
time ? 

<87> Dina: Yeah, this time I want to start from the 
beginning. [While she creates another graph 
not shown here] that's an OK “N. " That's an 
“M. " Then here goes an “1 V. " When I did the 
“M" [she says looking at the completed graph] 
I was trying to do an “N, " but it kind of got 
mixed up. Well, it didn't get mixed up I just 
kind of did it. 



TERC Working ...Papers 





<88> Tracey: Yeah, you changed your plan, and you 
turned your “N” into an “M. ” (. . .) 

Dina started with a plan, but then she altered the 
plan according to her shifting interpretation of the 
graph appearing on the screen. Once the graph was 
completed Dina reinterpreted the result and how it 
diverged from her original intentions. This dynamic 
was a constant in Dinas approach. 

Dina then suggested interpreting graphs as they 
are produced instead of planning them in advance. 

<89> Dina : What if we just doodled and then thought 
of something it looked like? 

<90> Tracey: Yeah, that's another way to do it. 

<91 > Dina: That's the way, sometimes when I'm bored 
I do that with the clouds. 

<92> Tracey: Oh, I know what you mean. 

Intending to “doodle,” Dina created Figure 17. 

<93 > Dina: [after finishing Figure 17] When I 
started to make these two bumps [marking 
Figure 17 between seconds 6 and 10] I started 
to make a beak, kind of like a weirdo animal 




Figure 17. Dinas graph reflects her doodling as a way to interpret graphs as 
a shape while they are being produced. 



or something. I don't know. But I didn't. . . 

<94 > Tracey: So it looks like a beak that got. . . 

<95 > Dina: Smashed. [Tracey: Yeah.] It doesn't 
really look like one. 

Dina focused her analysis on the graph as a shape. 
She intended to draw a beak, but then it became 
something different, momentarily unintended, for 
which she tried to fit a new figural resemblance (like 
a beak that got smashed). Dinas prevalent approach 
to planning and interpreting graphs was based on her 
use of the drawing experience. 

At this point, Tracey and Dina started to graph 
simultaneously with two buttons, one creating a 
blue graph and the other creating a yellow graph. 
Dina expressed a keen interest. 

<96> Dina: [the graph starts] Oh, it's started. Am I 
blue or yellow? Yellow. That looks like an inter- 
esting doodle. [Looking at the screen as if 
admiring a work of art]. It looks nice with 
the colors mixed. 

<97 > Tracey: It does. 

<98 > Dina: It looks like water with the blue. 

[Tracey: Yeah, I was trying to follow you.] 

Well, I'm not saying I want to or anything, 
but maybe if you had all four [buttons (there 
were four buttons on the table)], you could use 
one at a time on the same graph and you could 
make a nice picture with all the colors. That 
would be fun. 

<99 > Tracey: That would be beautiful. (. . .) What 
could we do with the two [buttons]? 
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Dina assessed the aesthetic value of her graphical 
productions. Part of the drawing experience for her 
means to produce “nice” or “beautiful” images. It 
was natural to Dina to comment on how colorful 
the four-button graph would be, because this is the 
kind of judgment that we practice in appreciating 
a drawing. 

<100> Dina: Do you know anything with two lines ? 
Electricity poles. We can make straight down for 
the poles, and then go back up and make it 
straight and then another pole and so on. But 
I dont know. Im not sure. [Tracey: Oh, OK. 
How would we start?] (. . .) Once its about at 
the second square [on the screen] we can start 
the stick. We could go a little higher and then 
go straight down y and then go up. No, because 
that would be bumped and then straight. Im 
not sure how that would make a stick. 

<101> Tracey: Ids hard to make a stick. 



out from the bottom and make the stick just by 
going “straight up.” 

<103> Tracey: We could just do the wires somehow. 
What do the wires look like? 

<104> Dina: Theyre just straight lines. [Tracey: 

Just straight lines.] We could make like . . . if 
we started out from the bottom and then went 
straight up, then made the wires. I dont know. 
Im not sure. 

Note how Dina used the verb “to go” to indicate 
motions in the graphical space; “go a little higher,” 
“go straight down,” “go up,” “went straight up” 
meant in all cases a movement of a line within the 
graph. Such a “going” did not describe the motion 
of the hand in space but the genesis of the graph as 
a gradual movement on the computer screen. Tracey 
then turned the conversation toward the graph as 
a response to actions, motivating a different type 
of description. 



<102> Dina: And then go back up. Unless we 

traced the stick but I dont know how. Thats 
not a too good idea. 

Dina anticipated difficulties in graphing a vertical 
stick because the unavoidable displacement to the 
right would make it “bumped.” This is another 
example — like the square that was so simple to 
draw and impossible to graph from Part I — of 
Dinas emerging sense of the difference between 
graphing and drawing; in this case it is the difficulty 
of graphing a vertical line by “going down” and 
then retracing it on its “way up.” The impossibility 
of being twice on the same line led Dina to suggest 
in the next excerpt that, perhaps, one could start 



<105> Tracey: Oh, so if we start at the bottom then 
how would we move to get it to go straight up? 

<106> Dina: Get far, real fast. 

<107 > Tracey: OK, and then. ..to do the wires? 

<108> Dina: You just keep it straight. 

In the former exchange the motion on the 
graphical space and the body motion get inter- 
mingled. “Start at the bottom” indicates location and 
movement on the graph, and “how would we move?” 
is a question about their body motion. But “we,” 
that is, Tracey and Dina, are at once in both realms: 
“we start at the bottom. . .” and “how would we 
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move. . Dina, responding to the body motion 
“side” of the question, says “Get far, real fast.” 
Regarding the production of the wires Dina says 
“just keep it straight.” Note that “just keep it straight” 
alludes to both, the action with the button, that is, 
the stillness of the hand holding the button and the 
straightness (horizontality) of the line going steadily 
to the right. 

<109> Tracey : And do you want the wires ? How do 
you want . . . ? 

<110> Dina: (. . .) usually they’re [a pair of wires] 
kind of separate, so. . . One [of us] could be 
closer [to the tower] than the other. 

| < 1 1 1 > Tracey: Are you going to be the closer one or 

the further one? [Dina: I don’t care.] OK, 
we’ll just try it. (...) 

For Dina the graph as a shape is a way of talking 
about it, a way of sharing plans and pointing at the 
different parts of the graph. Her image of the two 
parallel wires gets transformed in a plan: to do the 
! wires they should do similar body motions but one 
closer to the tower than the other. Using the imagery 
of drawings enriched Dinas resourcefulness. 

As they created Figure 18, Dina, at the 10th 
second, said: 

<11 2> Dina: That looks. . . an elephant. (...) 

After Figure 18 was complete, Dina made the 
following point: 

<11 3> Dina: When we were still about here [she marks 
around the 10th second], I was thinking we 
could have made an elephant if we went straight 
down. So. . . an elephant drinking water? 

O 

[ERIC 






“When we were still about here,” Dina said. 
Where is “about here”? When in their past had they 
been “there”? Dinas utterance expresses a discourse 
in which “being somewhere,” or “going from here 
or there,” means at once body motion and displace- 
ment on the graph. Note that as she says “When we 
were still about here” Dina knows perfectly well that 
they have never been physically on the computer 
screen, and yet there is a web of relationships that 
are manifest because she points at their location on 
the screen; in other words, if she had said “about 
here,” pointing at a place on the floor, nothing would 
have suggested to them why her idea of the elephant 
came up to her imagination on that particular spot; 
what counted was that Dinas “about here” on the 
screen made obvious because of the pictorial image 
that their whole body motion up to that point could 
be thought of as a half-elephant. 

Dinas experience of fusion not only merged body 
actions and shapes on the computer screen but also 
past and present. Dina was talking about a past 
event: “When we were. . The genesis of the graph 




Figure 18. Dinas graph of an “elephant" reflects her resourcefulness in 
planning and discussing a graph. 
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